bold signal
Integrated accounts of behavioral and neuroimaging data using flexible recurrent neural network models
Neuroscience studies of human decision-making abilities commonly involve subjects completing a decision-making task while BOLD signals are recorded using fMRI. Hypotheses are tested about which brain regions mediate the effect of past experience, such as rewards, on future actions. One standard approach to this is model-based fMRI data analysis, in which a model is fitted to the behavioral data, i.e., a subject's choices, and then the neural data are parsed to find brain regions whose BOLD signals are related to the model's internal signals. However, the internal mechanics of such purely behavioral models are not constrained by the neural data, and therefore might miss or mischaracterize aspects of the brain. To address this limitation, we introduce a new method using recurrent neural network models that are flexible enough to be jointly fitted to the behavioral and neural data. We trained a model so that its internal states were suitably related to neural activity during the task, while at the same time its output predicted the next action a subject would execute. We then used the fitted model to create a novel visualization of the relationship between the activity in brain regions at different times following a reward and the choices the subject subsequently made. Finally, we validated our method using a previously published dataset. We found that the model was able to recover the underlying neural substrates that were discovered by explicit model engineering in the previous work, and also derived new results regarding the temporal pattern of brain activity.
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.06)
- Asia > Singapore (0.04)
- Oceania > New Zealand > North Island > Gisborne District > Gisborne (0.04)
- North America > United States (0.04)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.88)
- Law (1.00)
- Information Technology (1.00)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Government (1.00)
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.05)
- Asia > Singapore (0.04)
- Oceania > New Zealand > North Island > Gisborne District > Gisborne (0.04)
- (3 more...)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.93)
- Workflow (0.68)
- North America > United States (0.14)
- South America > Peru > Lima Department > Lima Province > Lima (0.04)
- Asia > China > Guangdong Province > Shenzhen (0.04)
- Europe > France > Grand Est > Bas-Rhin > Strasbourg (0.04)
- Research Report > New Finding (1.00)
- Overview (0.67)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Health & Medicine > Health Care Technology (1.00)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
Integrated accounts of behavioral and neuroimaging data using flexible recurrent neural network models
Neuroscience studies of human decision-making abilities commonly involve subjects completing a decision-making task while BOLD signals are recorded using fMRI. Hypotheses are tested about which brain regions mediate the effect of past experience, such as rewards, on future actions. One standard approach to this is model-based fMRI data analysis, in which a model is fitted to the behavioral data, i.e., a subject's choices, and then the neural data are parsed to find brain regions whose BOLD signals are related to the model's internal signals. However, the internal mechanics of such purely behavioral models are not constrained by the neural data, and therefore might miss or mischaracterize aspects of the brain. To address this limitation, we introduce a new method using recurrent neural network models that are flexible enough to be jointly fitted to the behavioral and neural data. We trained a model so that its internal states were suitably related to neural activity during the task, while at the same time its output predicted the next action a subject would execute. We then used the fitted model to create a novel visualization of the relationship between the activity in brain regions at different times following a reward and the choices the subject subsequently made. Finally, we validated our method using a previously published dataset. We found that the model was able to recover the underlying neural substrates that were discovered by explicit model engineering in the previous work, and also derived new results regarding the temporal pattern of brain activity.
De-Individualizing fMRI Signals via Mahalanobis Whitening and Bures Geometry
Jacobson, Aaron, Dan, Tingting, Styner, Martin, Wu, Guorong, Kovalsky, Shahar, Moosmueller, Caroline
Functional connectivity has been widely investigated to understand brain disease in clinical studies and imaging-based neuroscience, and analyzing changes in functional connectivity has proven to be valuable for understanding and computationally evaluating the effects on brain function caused by diseases or experimental stimuli. By using Mahalanobis data whitening prior to the use of dimensionality reduction algorithms, we are able to distill meaningful information from fMRI signals about subjects and the experimental stimuli used to prompt them. Furthermore, we offer an interpretation of Mahalanobis whitening as a two-stage de-individualization of data which is motivated by similarity as captured by the Bures distance, which is connected to quantum mechanics. These methods have potential to aid discoveries about the mechanisms that link brain function with cognition and behavior and may improve the accuracy and consistency of Alzheimer's diagnosis, especially in the preclinical stage of disease progression.
- North America > United States > North Carolina (0.04)
- Europe > Switzerland > Basel-City > Basel (0.04)
- Research Report > New Finding (0.34)
- Research Report > Experimental Study (0.34)
- North America > United States (0.14)
- South America > Peru > Lima Department > Lima Province > Lima (0.04)
- Asia > China > Guangdong Province > Shenzhen (0.04)
- Europe > France > Grand Est > Bas-Rhin > Strasbourg (0.04)
- Research Report > New Finding (1.00)
- Overview (0.67)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Health & Medicine > Health Care Technology (1.00)
- Health & Medicine > Diagnostic Medicine > Imaging (1.00)
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.06)
- Asia > Singapore (0.04)
- Oceania > New Zealand > North Island > Gisborne District > Gisborne (0.04)
- North America > United States (0.04)
- Research Report > Experimental Study (0.93)
- Research Report > New Finding (0.68)
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Law (0.94)
- Information Technology (0.94)
- Government (0.93)
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.05)
- Asia > Singapore (0.04)
- Oceania > New Zealand > North Island > Gisborne District > Gisborne (0.04)
- (3 more...)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.93)
- Workflow (0.68)
we will publish both the data and code if the paper is accepted---this was an oversight by us for not making clear we
We thank the reviewers for their thoughtful reviews and below we address their major concerns. This variability would be expected even from different recording sessions for the same subject. This allows researchers to add multiple covariates (e.g., different experimental Also related to Reviewer 1's comments, it is certainly possible to have different numbers Another major point/question raised by the reviewers was the sensitivity of our results to our intialization procedure. It is not necessary but it simplifies the inference derivation.